Complex Event Pattern Recognition Software for Multimodal User Interfaces
نویسنده
چکیده
We describe how CERA, the Complex Event Recognition Architecture, was used to create a multimodal user interface for Skibbles, a memory game moderated by a mobile robot. We also announce the availability of open-source software that implements CERA, and how it can be used to build intelligent multimodal interfaces.
منابع مشابه
MIBO - A Framework for the Integration of Multimodal Intuitive Controls in Smart Buildings
With the Internet of Things expanding into our homes and offices, we can expect fixtures in buildings to become more interconnected and more numerous as part of an increasingly complex and powerful integrated smart environment. However, this raises new challenges in the area of usability since today’s rooms are already cluttered with multiple user interfaces in the form of buttons and remote co...
متن کاملVisualization in Multimodal User Interfaces of Mobile Applications
Advanced user interfaces are an important aspect of mobile information systems. They should provide state-of-the-art visualization and interaction techniques tailored for specific tasks, while at the same time allow flexible deployment of these components on a multitude of (mobile) hardware platforms. Especially visualizations have to adapt to the platform capabilities in order to remain not on...
متن کاملCUIML: A language for generating multimodal human-computer interfaces
CUIML, the Cooperative User Interfaces Markup Language, was developed as part of the DWARF project. The goal of DWARF is the development of a framework for augmented reality applications running on wearable computers. For wearable systems, the HCI (human-computer interface) consists of numerous I/O devices such as head mounted displays, palm-size devices, and speech recognition systems. This sh...
متن کاملUsing Speech and Language Technology to Coach Reading
BravoBrava! is expanding the repertoire of commercial user interfaces by incorporating multimodal techniques combining traditional point and click interfaces with speech recognition, speech synthesis, and gesture recognition. One of these applications is software to help children read. While the child reads aloud, the computer keeps the child on track and offers feedback when the child has diff...
متن کاملThe Effect of Perceptual Structure on Multimodal Speech Recognition Interfaces
A framework of complementary behavior has been proposed which maintains that direct manipulation and speech interfaces have reciprocal strengths and weaknesses. This suggests that user interface performance and acceptance may increase by adopting a multimodal approach that combines speech and direct manipulation. This effort examined the hypothesis that the speed, accuracy, and acceptance of mu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004